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O ! Abstract 

A new notion of partition-determined functions is introduced, and several basic new 
qj ' inequalities are presented for the entropy of such functions of independent random vari- 

^"^ . ables, as well as for cardinalities of compound sets obtained using these functions. Here 

a compound set means a set obtained by varying each argument of a function of several 
variables over a set associated with that argument, where all the sets are subsets of an 
appropriate algebraic structure so that the function is well defined. The compound set 
inequalities imply, in turn, several inequalities for sumsets, providing for instance partial 
progress towards a conjecture of Ruzsa (2007) for sumsets in nonabelian groups. 
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It is well known in certain circles that there appears to exist an informal parallelism between 



l/-) entropy inequalities on the one hand, and set cardinality inequalities on the other. In this 

paper, we clarify some aspects of this parallelism, while presenting new inequalities for both 
q ! entropy and set cardinalities. 

A natural connection between entropy and set cardinalities arises from the fact that the 
entropy of the uniform distribution on a finite set of size m is just logm, and this is the 
maximum entropy of any distribution supported on the same set. Consequently, inequalities 
for entropy lead to inequalities for cardinalities of sets. For instance, by choosing (X, Y) to be 
uniformly distributed on the set A C B x C, the classical inequality H(X, Y) < H(X) + H{Y) 
implies log \A\ < log \B\ + log \C\ or |A| < \B\ ■ \C\. 

For the joint entropy, there is an elaborate history of entropy inequalities starting with the 
chain rule of Shannon, whose major developments include works of Han, Shearer, Fujishige, 
Yeung, Matus, and others. The classical part of this work, involving so-called Shannon-type 
inequalities that use the submodularity of the joint entropy, was synthesized and generalized 
in 1 1 3 1. II 4 j . where an array of lower as well as upper bounds were given, for the joint entropy of 
a collection of random variables generalizing inequalities of Han [9], Fujishige [7] and Shearer 
[4]. For the history of the non-classical part, involving so-called non-Shannon inequalities, 
one may consult for instance, Matus [15] and references therein. 

Entropies of sums, even in the setting of independent summands, are not as well un- 
derstood as joint entropies. For continuous random variables, the so-called entropy power 
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inequalities provide important lower bounds on entropy of sums, see, e.g., [12]. For discrete 
random variables, an unpublished work of Tao and Vu [19] gives some upper bounds on 
entropy of sums, and discusses the analogy between entropy of sums of random variables 
(instead of joint entropy) and sumset cardinality inequalities (instead of set projection in- 
equalities) on the other. In this paper, we develop this analogy in directions not considered 
in [19], and prove more general inequalities both for entropies and sumsets. 

A key contribution of this paper is the isolation of the notion of a function that is partition- 
determined with respect to a set. This means that the function (more precisely, an extension 
of it) can be defined on a subset of its arguments, in such a way that the original function 
can be recovered by looking at the functional value on the subset and on its complementary 
subset. The projection and sum functions are merely the simplest example of such partition- 
determined functions. 

Definition 1. Let X%, X%, . . . , Xk be finite sets. Any subset s C [k] corresponds to a different 
product space X s = n«Gs^- ^or se ^ s s — * — M> we define the projection function 
tc s : Xt — > X s in the natural way: for x G Xi, let tt s (x) = (xj 15 . . . >SEi. ,) where ij G s. (To 
avoid ambiguity, one may assume that the indices ij are labelled in increasing order, i.e., 
ij+i > ij.) When the meaning is clear, we will write tt^x) for tt^(x). 

We will use Q(X\, X2, ■ ■ ■ , Xk) to denote the space that is a disjoint union of each of the 
spaces X s , for s C [k]. Formally, 



Let Y be any space and / : Q(Xi, . . . , Xk) — ► Y be any function. Then, for a set s C [k], we 
define f s : X s — > Y to be the restriction of / to only those inputs that came from X s . We 
will abuse notation by writing, for s C t and x G t, f s (x) to mean f s (7r s (x)), and when the 
domain is clear, we will merely write f(x). 

Let C be a collection of subsets of [k] and let s denote [k] \ s for all s G C. We will say 
that a function / defined on Q(Xi,X2, ■ ■ ■ ,Xk) is partition- determined with respect to C if 
for all s G C and for all x,y G Xy k \ we have that f(x) = f(y) whenever both f s (x) = f s (y) 
and fj{x) = fs(y). 

The definition above is intended to capture the property of sumsets that was mentioned 
earlier. For a function / to be partition-determined with respect to a single set s C [k], it 
must be that f s (x) and fs(x) uniquely determine the value of f(x). Then being partition- 
determined with respect to a collection C is nothing more than being partition-determined 
with respect to all s G C. 

Simple examples relevant for consideration include Cartesian products of sets and linear 
combinations of sets (and so, in particular, sumsets). Both these classes of examples are 
partition-determined with respect to C for any C. 

Example 1. Let V be a vector space over the reals with basis vectors {v\, . . . ,Vk} ■ Let 
X±, . . . , Xk C R, and define f : Q{X\, . . . , Xk) — > V such that f s (x) = J2ies 7T i( x ) v i- Then f 
is partition- determined with respect to C for all collections C of subsets of [k]. 

Proof. Let x G Xt for some t C [k] and let s G C where C is a collection of subsets of [k]. 



Q(X u X 2 ,...,X k ) = (J {(. 



Xi..) :xi G Xi,s = {i\ 



■ ■•.»m}} 



sC[k] 



Then 




ie(snf) 



ie(snt) 



2 



Thus knowing f s (x) and fs{x) uniquely determines f{x). Since this is true for any s € C, f 
is partition-determined with respect to C. □ 



Example 2. Let (£/, +) be an Abelian group and X±, . . . , X k C (J and let c\, . . . ,Ck € 7L. De- 
fine f : Q{X\, . . . ,Xk) — > s-uc/t i/iaf / s (x) = X^ies Ci 71 "^)- 27ien / is partition- determined 
with respect to C for all collections C of subsets of [k] . 

Proof. The proof is identical to Example [H only replacing Uj with c, . □ 



Equipped with the notion of partition-determined functions, we prove an array of inequal- 
ities for both entropy and set cardinality. For instance, we have the following results for sums 
as corollaries of general statements for partition-determined functions. 

Illustrative Entropy Result: Let Z\,...,Z n be independent discrete random variables 
taking values in the group Q, and let C be an r-regular hypergraph on [n]. Then 

H(Z 1 + ... + Z n )<lj2 H (j2^ 



Illustrative Set Cardinality Result: Let A,Bi,B2, ■ ■ ■ ,B n C Q be finite subsets of the 
Abelian group Q. If C is a r-regular hypergraph on [n], then for any D C B\ + . . . + B n , 



\A + D\W < |£| |Chr n A + 



This set inequality (and others for sums, projections etc.) is obtained as a corollary of 
inequalities for cardinalities of compound sets. Here a compound set means a set obtained 
by varying each argument of a function of several variables over a set associated with that 
argument, where all the sets are subsets of an appropriate algebraic structure so that the 
function is well defined. In other words, for subsets X±, . . . , X}. of some ambient space X, we 
will always use the notation 

f(X u .. .,X k ) = {/(zi, ... ,x k ) : X! E X u ... ,x k e X k }. 

When the ambient space is a group, the only operation available is the sum, and all com- 
pound sets are sumsets. When the ambient space is a ring, one may consider compound sets 
built from polynomials. For particular ambient spaces, such as Euclidean space, the class of 
functions available is extremely broad and therefore so is the class of compound sets that can 
be considered. 

This paper is organized as follows. Section \2 . 1 1 presents preliminaries on mutual informa- 
tion, and a key lemma on entropies of partition-determined functions. Section T2.2I presents a 
rather general new submodularity property of the entropy for strongly partition-determined 
functions (defined there) of independent random variables. Surprisingly, this result is entirely 
elementary and relies on the classical properties of joint entropy. Section 12.31 uses this result 
to demonstrate new, general upper bounds on entropies of partition-determined functions. 
Section f2.4l considers applications to particular partition-determined functions such as sums. 

Section 13.11 applies joint entropy inequalities to obtain a basic but powerful result about 
compound sets. Section 1331 discusses the relation between this general result and the entropy 
inequalities for partition-determined functions obtained in Section [2 
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The remaining subsections of Section [3] discuss various consequences of the basic result 
for compound set cardinalities in Section \3. 11 Section T3.3I gives a first easy application of the 
compound set result to obtaining well known cardinality inequalities for projections of sets. 

Section [3.41 gives a second, and important, application to sumsets in Abelian groups. In 
this, we build on recent work by Gyarmati, Matolcsi and Ruzsa [8], who noted that Han-type 
inequalities can be applied to sumsets in much the same way that they can be applied to 
characteristic functions of sets of random variables (the usual situation) . While it is not true 
in general that sumsets satisfy a log-submodular relation in an obvious way, it is natural to 
ask whether they permit a weaker property, by way of fractional subadditivity. It is classical 
(and recently reviewed in p3| ) that fractional subadditivity is weaker than log-submodularity 
and more general than Han's inequalities. Here, by extending an idea embedded in [8], and 
making further use of entropy, we show a general fractional subadditivity property for sumsets 
that implies some of the results and conjectures in [8] as easy corollaries. It should be noted 
that some of the results and conjectures in [8] were discovered independently of our results in 
this paper by Balister and Bollobas pQ who, following the works of Gyarmati, Matolcsi, and 
Ruzsa [8] and Madiman and Tetali [H], also developed a hierarchy of entropy and sumset 
inequalities. 

Section 13.51 applies the compound set inequalities to obtain results for sumsets in non- 
Abelian groups, motivated by a conjecture of Ruzsa [18]. In particular, we make partial 
progress towards resolving Ruzsa's conjecture. 

In Section [3.61 we present a novel application of our basic result to obtaining cardinality 
bounds for compound sets in rings that are more general than sumsets (such as the compound 
sets g(A, B) in a ring obtained from g(a, b) = a? + b 2 or <?(a, b) = a 2 — b 2 ). 

We wish to emphasize that apart from the novelty of our specific results, the approach 
we adopt using partition-determined functions provides a general and powerful framework 
for studying such inequalities. 

2 Entropy inequalities 

2.1 Partition-determined functions and mutual information 

As usual, we denote by [n] the index set {1,2, ... ,n}. Let Zr n i = (Z\, Z2, ■ ■ ■ , Z n ) be a 
collection of random variables taking values in some discrete group (£/,+). If the probability 
distribution of Zj n ] has joint probability mass function p(zj n j) = P(Zr n i = zr n i), where zy = 
(zi, . . . , z n ), then the entropy of Zu is defined by 



Recall that the conditional entropy of Z given Y, denoted H{Z \ Y), is defined by taking the 
mean using the distribution of Y of the entropy of the conditional distribution of Z given 
Y = y. The trivial fact that H(Z,Y) = H(Z) + H(Y\Z) is known as Shannon's chain rule 
for entropy. For any function /, it is easy to see that H(f(Z)) < H(Z), with equality if and 
only if / is a bijection. 

The mutual information between two jointly distributed random variables Z and Y is 
defined by 




I{Z;Y)=H{Z)-H{Z\Y), 
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and is a measure of the dependence between Z and Y. In particular, I(Z; Y) = if and only 
if Z and Y are independent. 

Analogous to conditional entropy, one may also define the "conditional mutual informa- 
tion" I(Z;Y | X), which quantifies how much more information about Y one can glean from 
the pair [X, Z) as compared to simply X. More precisely, 

I(Z;Y \X)=I(X,Z;Y)-I(X;Y) 

= H(X, Z) - H(X, Z\Y)- [H{X) - H{X \ Y)\ (1) 
= H{X, Z) - H(X, Z, Y) - H(X) + H(X, Y), 

where the alternate form in the last display was obtained by adding and subtracting H(Y) 
in the last step, and using Shannon's chain rule for entropy. 

The following lemma gives a simple and classical property of mutual information. 

Lemma 1. The mutual information cannot increase when one looks at functions of the 
random variables (the "data processing inequality"): 

I(f(Z);Y)<I(Z;Y). 

Proof. A proof can be found in elementary texts on information theory such as Cover and 
Thomas [5]. □ 

The following simple but new observation will turn out to be very useful. We first 
need to define a strengthened notion of partition-determined functions. We say that / : 
Q(X\, . . . ,Xk) — ► Y is strongly partition- determined if for any disjoint sets s and t, given 
ft, f s is determined by f s ut- Observe that the converse is always true, i.e., given f t , f s de- 
termines f s ut if / is partition-determined. Also, both running examples, namely projections 
and sums, are strongly partition-determined functions. For brevity, we simply write H(f s ) 
for H(f s (Z)). 

Lemma 2. Suppose Xi are finite sets, and f : Q — > V is a partition- determined function. Let 
Zi, . . . , Z n be random variables, with Z\ taking values in Xi. Then, for disjoint sets s,t C [n], 

I(fsuf,ft)>H(f sUt )-H(f s ). (2) 
If, furthermore, f is strongly partition- determined and Z\, . . . , Z n are independent, then 

I(fsuf,ft) = H(f sUt )-H(f s ). (3) 
Proof. Since conditioning reduces entropy, 

H(fsut) ~ H(f s ) < H(f sUt ) - H(f s \f t ). 
But since / is partition-determined, / s u* = <j>{fsift) f° r some function cj), and hence 

H(f s \f t ) = H(f s ,f t \f t ) > H(f sUt \f t ). 

Thus 

H(f s ut) ~ H(f s ) < H(f sUt ) - H(f sUt \f t ) = I(f sUt ; f t ). 

This yields the first part of the lemma. For the second part, note that independence of 
Z\, . . . ,Z n guarantees equality in (a), while / being strongly partition-determined guarantees 
equality in (b). □ 
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2.2 A basic result for entropy 

The inequality below, while a simple consequence of the above elementary facts, is rather 
powerful. 

Theorem 1. [Submodularity for Strongly Partition-determined Functions] Sup- 
pose Xi are finite sets, and f : Q — > V is a strongly partition- determined function. Let 
Zi, . . . , Z n be independent random variables, with Z% taking values in Xi. Then 

H(f sUt ) + H(f snt ) < H(f s ) + H(f t ). (4) 

Proof. First note that it suffices to prove the result for n = 3. For this case, we have 

H (f{i,2}) + #(/{2,3}) ~ #(/{i,2,3}) - H (f{2}) 
= # (/{i,2}) " H(f {2} ) - [H(f M} ) - H(f {m )] 

= i(f{i,2y, /{i}) - ^(/{i,2,3}; 

using ([3j) from Lemma [21 Thus we simply need to show that 

^(/{i,2};/{i>) > ^(/{i,2,3}; 

Now 

(a) 

n/{i,2,3};/{i}) < n/{i,2},/{3};/{i}) 

- I(f {1,2}! /{I}) + ^(/{3}5 /{1}I/{1,2}) 

- J (/{1,2>; /{l}) 

where (a) follows from the data processing inequality, (b) follows from (TJQ) and (c) follows 
from the hypothesis of independence; so the proof is complete. □ 



A consequence of the submodularity of entropy of sums is an entropy inequality that obeys 
the partial order constructed using compressions, as introduced by Bollobas and Leader [2]. 
Following Balister and Bollobas [1], we introduce some notation. Let M(n,m) be the family 
of multisets (allowing repetition) of non-empty subsets of [n] with a total of m elements. 
Consider a given multiset C = {s\, . . . , si} € M(n, m). The idea is to consider an operation 
that takes two sets in C and replaces them by their union and intersection; however, note 
that (i) if Si and Sj are nested (i.e., either Sj C Sj or Sj C Sj), then replacing (si,Sj) by 
(si n Sj, Si U Sj) does not change C, and (ii) if Si n Sj = (ft, the null set may enter the collection, 
which would be undesirable. Thus, take any pair of non-nested sets {si,Sj} C C and let 
C = C(ij) be obtained from C by replacing s, and Sj by Sj n Sj and Sj U Sj, keeping only 
Si U Sj if Si n = C is called an elementary compression of C. The result of a sequence 
of elementary compressions is called a compression. 

Define a partial order on M(n, m) by setting .A > B if S is a compression of .4. To check 
that this is indeed a partial order, one needs to rule out the possibility of cycles, which can 
be done by noting that 

£m 2 <En 2 ; 

seA seA' 
if A' is an elementary compression of A. 
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Theorem 2. Let A and B be finite multisets of subsets of [n], with A > B. Let Z\, . . . , Z n 

be independent random variables, with Z{ taking values in the finite set JQ. Writing f s = 
f s {Z\, . . . , Z n ), 

£ff(/.)>2>(/t). 

s£A teB 

Proof. The proof follows exactly the same reasoning as given by Balister and Bollobas pQ for 
the special case of / being the identity function (or f s being the projection function). When 
B is an elementary compression of A, the statement is immediate from the submodularity of 
H(f s ) proved in Theorem [H and transitivity of the partial order gives the full statement. □ 

Note that for every multiset A £ M{n, m) there is a unique minimal multiset A& domi- 
nated by A consisting of the sets sj = {i € [n] : i lies in at least j of the sets s £ ^4}. Thus 
a particularly nice instance of Theorem [2] is for the special case of B = A^. 

2.3 Upper bounds for entropy of a partition-determined function 

Since we wish to consider sums of various subsets of random variables, the following notation 
and definitions will be useful. Let [n] be the index set {1,2, . . . , n}. We are interested in a 
collection C of subsets of [n] . 

For any index i in [n], define the degree of i in C as r(i) = \{t & C : i 6 t}\. A function 
a : C — > M + , is called a fractional covering, if for each i G [n], we have ^sec-ies ° s — ^- ^ a 
satisfies the equalities ^2 s€C . i€s a s = 1 for each i £ [n], it is called a fractional partition. If 
the degree of every index i in C is exactly r, C is called a r-regular hypergraph, and a s = 1/r 
for every s € C constitutes a fractional partition using C. 

Theorem 3. [Upper Bound for Entropy of Strongly Partition-determined Func- 
tion] If Z\, . . . , Z n are independent random variables taking values in the discrete group Q , 
then 

H(f [n] )<^2a s H(f s ), 

s€C 

for any fractional covering a using any collection C of subsets of [n] . 

Proof. Define the set function g(s) = H(f s ), and note that g((f>) = is the appropriate 
convention. Theorem [T] says that g is a submodular function. Now the corollary follows from 
the general fact that a submodular function g with g{4>) = is "fractionally subadditive" 
(see, e.g., [M]). □ 



For any collection C of subsets, [H] introduced the degree covering, given by 

1 



r_(s) 

where r_(s) = minj 6s r(i). Specializing Theorem[3]to this particular fractional covering, we 
obtain 

sec v ; 

A simple example is the case of the collection C m , consisting of all subsets of [n] with m 
elements, for which the degree of each index with respect to C m is ( n ~ 1 )- 
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2.4 Special cases 

The first (and best studied) special case of interest is when / is the identity mapping, so 
that f s is the projection onto the subset s of coordinates. In this case, Theorems [TJ El an d 
[3] reduce to the following fact. For any set s C [n], let Z s stands for the random variable 
(Zi : i 6 s), with the indices taken in their increasing order. If Z%, . . . , Z n are independent 
discrete random variables taking values in the group G, then 

fl-(Zi,...,Z„) <J2 a sH(Z s ), 

sec 

for any fractional covering a using any collection C of subsets of [n]. Of course, this fact is 
not particularly interesting (although true, and with equality for fractional partitions) in the 
context of independent random variables. For more on its validity in the general dependent 
case, see pH] , 

A second special case of interest is when the sets X{ are finite subsets of an ambient 
abelian group (Q, +), and / is just the sum function. 

Corollary 1. [Entropy of Sums in Abelian Groups] Let Z\,...,Z n be independent 
discrete random variables taking values in the group Q , and let 

ies 

Then: 

1. The set function /(s) = H{Zf) is submodular. 

2. If A> B then 

Y,H{Zt)>Y,H{Zt). 

3. For any fractional covering a using any collection C of subsets of [n], 

H(Z 1 + --- + Z n )<J2<XsH(Z+). 

sec 

Since the sum function in an abelian group is strongly partition-determined, the three 
statements in Corollary Q] follow from Theorems [2] and [3] respectively. Parts of Corollary Q] 
were presented in |10j . 

Note that while the simplest applications of Corollary [1] are to discrete groups, it continues 
to hold for arbitrary groups Q provided the random variables Z{ are supported on discrete 
subsets of Q. In fact, a modified version of Corollary [1] holds even beyond the discrete 
support setting. Specifically, one can work with (/-valued random variables on any locally 
compact topological group G, whose distribution is absolutely continuous with respect to the 
Haar measure on Q. Such continuous versions, and their application to matrix analysis, are 
explored in [llj . For instance, [11] shows that the following modified inequality holds even 
in the continuous setting where the entropy can be negative: if H(X) > 0, then 

V ie[n] 7 V J 

This is identical to Corollary Q] except that the random variable X is an additional summand 
in every sum. Some of the sumset inequalities we will discuss below have a similar flavor, in 
that a set appears in every sum. 
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3 Set cardinality inequalities 



3.1 A basic result for reduced sets 

The proofs in this section extend the arguments of Gyarmati, Matolcsi, and Ruzsa [5] (more 
precisely, an idea in Theorem 1.2 of their paper) while making further use of entropy. Given a 
collection of spaces Xi, their idea was to endow each Xi with an arbitrary linear order. Then 
for any set s C [k] and elements A,B G X s , they define A <i ex B if the vector representation 
of A comes before that of B in lexicographical order. 

In the statements and proofs that follow, we will work in the following setting: Let 
X\, X2, . . . , Xk be finite sets, and / be a function defined on Q(X±, X2, • • • , Xk). Now let 
Y Q be a given set that we wish to bound in size. For each y G Y, we define r(y) to 

be the smallest element of f~ 1 (y) C Xnu in lexicographical order and set R = {r(y) : y G Y}. 
Thus each y G Y has a unique "representative preimage" r(y), and \Y\ = \R\. 

The main observation is the following somewhat surprising lemma, whose proof is more 
or less obvious; this is also the essence (in addition to Han's Inequality) of the proof of 
Theorem 1.2 in [8]. 

Lemma 3. Let Z be a random variable that chooses uniformly from the elements of R. If f 
is partition- determined with respect to s, then 

H(Z S I f{Z s j) = 0. 

Proof. Since Z s takes values in tt s (R), it suffices to show that the restriction of / to the 
domain tt s (R) is a one-to-one function. Assume, for the sake of contradiction, that there 
are two elements a ^ b G X s such that f(a) = f(b) and both Pr{Z s = a) and Pr{Z s = b) 
are non-zero. Thus there must be "preimages" of a, b with respect to ir s ; that is, elements 
A,B G R such that tt s (A) = a and tt s (B) = b. Furthermore, A ^ B since a ^ b. 

Without loss of generality, let A <i ex B, and define the vectors A',B' G X^ by switching 
the values of a and b in A and B; that is 

Ai (= a,i) for i £ s 
Bi for i ^ s 



See Figure 1 for an example. 



a = (a 2 ,a 4 ,a 5 ) b = (62,64,65) 

A = (^,02,^3,04,05) B = (-81,62,-63,64,65) 

A' = (^1,62,^3,64,65) B' = (£1, 02,-83,04,05) 

Figure 1: Example of a, 6, A, B, A', B' with k = 5 and s = {2, 4, 5}. 

Note that since /(a) = /(b) and / is partition-determined with respect to s, it follows 
that f(A) = f(A') and f(B) = f(B'). Due to the fact that A and B were chosen to be the 
representatives of f{A) and f{B) respectively, one must have A <\ ex A' and B <\ ex B' . On 
the other hand A and A' agree on all i ^ s, so it must be that a <i ex b. The same argument 
for B and however, implies that b <^ e:r a, a contradiction. □ 
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The following result now becomes basic when considering such constructions. 

Theorem 4. Suppose f is partition- determined with respect to C, and a is a fractional 
covering of [k] using C. For any Y C /(Xny), we have that 

sec 

Proof. Let Z be a random variable distributed uniformly on the elements of R and let Z{ = 
TVi(Z) for all % € [k]. Then by the usual fractional subadditivity of entropy, we have 

log(\R\)=H(Z)=H(Z 1 ,...,Z k )<J2<XsH(Z s ) (5) 

sec 

where Z s = ir s (Z). By the chain rule for entropy, 

H(Z S | f(Z s )) + H(f(Z s )) = H(Z S , f(Z s )) = H(f(Z s ) | Z s ) + H{Z S ) (6) 

for each s eC. Here, H{f(Z s )\Z s ) = since / is completely determined by its input. On the 
other hand, H(Z s \f(Z s )) = by Lemma El so Equation [6] reduces to H(Z S ) = H(f(Z s )). 
Plugging this into Equation ([5]) yields: 

io g (|i?i) <j2<*sH(f(z s )) <x>.iog(i/.(fl)[) <J2 a ^(\fs{f[ k ](y))\) 

sec sec sec 

where the last inequality is due to the fact that R C fZ,(Y). Since |y| = \R\, our claimed 
result is true. □ 



Considering the full compound set rather than a subset of it yields the following corollary. 

Corollary 2. Suppose f is partition- determined with respect to C, and a is a fractional 
covering of [k] using C. Then 

\f(x [k] )\<n\f(x s )r. 

sec 

The only potential problem in obtaining Corollary [2] from Theorem[5]is that f~ l o f(X^) 
could in general be a superset of X^j, if the Xi are finite subsets of an ambient space G. 
However this is not a problem, since throughout we only require / to be defined on X^ (and 
hence can work with the range of the inverse function being thought of as restricted to Xrw)- 

Let us also mention here that Corollary [2] is not a consequence of an underlying submod- 
ularity property; in particular, one can generally find examples for which 

\fsut (frfon) I • \fsnt (fjfioo) l > \fs (f^on) I • I/* (/^ao) I- 

Such counterexamples in the cases of / corresponding to projections and sums are discussed in 
Sections 13 . 31 and 13 .41 respectively. This phenomenon appears to be in stark contrast to the cor- 
responding entropy statement (Theorem [T]) , which asserts for strongly partition-determined 
functions such as sums that such a submodularity holds for entropy. The discrepancy is 
explained by the fact that one needs to invoke a set of representatives to pass from entropy 
to set cardinality. 
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3.2 Remarks on the connection between the entropy and set inequalities 



Let Zi, . . . ,Z n be random variables supported by the sets Xi, . . . , X n respectively, and note 
that for any subset s C [n], the random variable f s (Z) is supported on the compound set 
f s (X). Thus the left hand side of Corollary ?? has the bound 

H(f s (Z)) < log] f s (X)\, (7) 

while its right hand side has the bound 

Y,<*sH(f s (Z)) <5> s log|/ s p0|. 

sec sec 

Corollary [2] says that these bounds themselves are ordered. This would be trivial from 
Theorem [3] if we could find a product distribution on (X±, . . . ,X n ) that made their sum 
uniformly distributed on its range, since then ([7|) would simply hold with equality. 

Interestingly, while it is in general not possible to find such product distributions, it is 
always possible to find a joint distribution (with dependence) that makes the sum uniformly 
distributed on its range. 

Lemma 4. There exists a joint distribution for Z on X which makes f^(Z) uniformly 
distributed on /m(X). 

Proof. Let \Xj\ = nij,j £ [k]. Clearly partitions (Y) into I subsets, where I = \Y\. 
For each y € Y, want 

^2 P(xi,---,x k ) = P(Z [k] =y) = j. 

{xi,...,x k )ef^(y) 

Thus there are I linear equations (one for each possible value of y) in the Ilje^] m i variables. 
(It is not necessary to write down a separate equation for all the probabilities summing to 
1 since that is implied by this linear system.) Observe that since I < \f(X^)\ < \X^\ = 
Y\je\k] m ji there are always more variables than equations, and that the linear independence 
of the equations ensures consistency and hence existence of solutions to the system. In fact, 
the following is an explicit positive solution: Let the element of the partition corresponding 
to y have size l y ; for each (x\, . . . ,x k ) € f^(y), set 

p(xi,...,x k ) = 

Thus one can find a probability distribution on that makes /(Xw) uniformly distributed 
on Y. □ 



If one insists on a product distribution, one gets / — 1 nonlinear (polynomial) equations 
in ^2j & \k]( m j ~ 1) variables. In the case of sumsets, the Cauchy-Davenport theorem implies 
that the number of equations is at least the number of variables. It is intriguing that both 
the simplest upper bound as well as the simplest lower bound for sumsets appear in counting 
equations needed for the existence of general and product distributions respectively, leading 
to the uniform distribution on the sumset. Even when the number of equations exactly 
equals the number of variables, however, the nonlinearity implies that real solutions may fail 
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to exist. For instance, consider the sets X\ = X2 = {0, 1}. If Z\ and Z2 take the value 1 
with probabilities p and q respectively, the conditions 

1 w . 1 

P9=g. (l-p)(l-9) = g 

can be solved only if p and g are allowed to be complex. 

In summary, we have the following observation. The hoped-for simple method of proof of 
Corollary [2] from Theorem [3] as outlined above fails because of the independence requirement 
of Theorem[3j The method of proof of Corollary[2]in Section lBTTl using the uniform distribution 
on a set of representatives is precisely designed to address this problem. 

It is pertinent to note that the inequality of Theorem [3] does in fact hold for one particular 
choice of non-product distribution, namely, for the random variable Z that is uniformly 
distributed on the set of representatives. Indeed, by Lemma EH the submodularity of H(Z S ) 
implies that H(f s (Z)) is submodular. 

3.3 Corollaries on set projections 

There are some long known inequalities for the cardinalities of set projections that can be 
seen as trivial applications of Theorem [H We mention this way of proving them only for 
completeness, and to illustrate the unifying nature of Theorem HI 

Corollary 3. Let a be a fractional covering using the hypergraph C on [k]. Let X%, . . . ,Xk 
be arbitrary finite sets, and Y C Xny . Then 

\Y\<H\n s (Y)r. 

sec 

Proof. Apply Theorem U] to the function f s = ir s , which is obviously partition-determined 
with respect to any collection C. □ 

For instance, Lemma 3.1 of Gyarmati, Matolcsi and Ruzsa [8j follows from CorollaryO As 
suggested there, these inequalities can be directly derived either from Shearer-type entropy 
inequalities (such as those of [14J) or from the Box Theorem of Bollobas and Thomason [3]. 

It is pertinent to note that the stronger submodularity inequality 

■ k»™00l < M y )l • \n(X)\ 

does not hold. For a counterexample, consider Xi = {0,1} for i = 1,2,3, and let Y = 
{(0,0,0), (1,0,0), (0,1,0), (0,0,1), (1,0,1)}. Then|vr {li2} (Y)| = 3, |7r {2j3} (y)| = 3, k {1>2j3} (F)| = 
5 and k{2}(^)| = 2, and 10 > 9. (This counterexample is implicit in Balister and Bollobas 

m 

3.4 Corollaries on Abelian sumsets 

The following corollaries are a slight variant on Theorem [J] in that they do not directly define 
R; rather, they pick a subset D of the image of one of the subspaces, then lift the preimage 
of D up to the top space. 
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Theorem 5. Let A, B\, B2, ■ ■ ■ , B^ C G, where G is an Abelian group. For any s C [k], 
define 

which is well defined by commutativity of addition. Let a be any fractional partition on [k] 
using the collection C of subsets of [k]. Then, for any D C B^, 

\A + D\ c < {Df- 1 Y[\A + B+\ a % 
sec 

where c = X^eC a s- 

Proof. Set Xi = Bi for i € [k], and Xk+i = A. Let X^+i] be the Cartesian product set. 
Clearly, the collection of functions f s {x) = J2ies x ^ f° r s C [A; + 1], is partition-determined 
with respect to any collection C' of subsets of [k + 1]. Since D C f^(X), set Q = f^}{D), 
then Q C Xm. Note that Y = D + A can be written as 

Y = {/(6i,...,6 fc ,a) : (&!,...,&*) € Q,a € .4}. 

Now choose 

C' = {[k]} U {«' :s' = sU{Hl},s€C}. 

For each set s G C, let 

av 

7su{fc+i} — ^ 

and let 

1 



7[fc] 



1 



Note that 7 is a fractional covering for [A; + 1] using C; for the index k + 1, one has 



and for each j € [A;], one has 



^2 7sU{fc+l} = 1 

sec 



T[fe] + 7su{fc+i} = 1- 



By Theorem HI we have that 



7 S ' 



s'ec 

Using the fact that /^^(y) = Q x A, it is easy to see that /^] ^/^^(y)! = -D, and 
that if s' = s U {k + 1} for s C [7c], 

/V {r\Y))CB+ + A. 

The result follows. □ 



13 



By applying Theorem [5] to a r-regular hypergraph C, for which a s = - gives a frac- 
tional partition, we obtain the following corollary (this is the Illustrative Set Result in the 
Introduction). 

Corollary 4. Under the assumptions of Theorem^ if C is a r-regular hypergraph, then for 
any D C B+ , 

\A + Df l < \D\M- r Y[\A + B+\. 

Note that when C = C\ is the collection of singleton sets, Corollary 2] reduces to Theorem 
1.5 of Gyarmati, Matolcsi, and Ruzsa [8], namely 

k 

\A + D\ k < | J D| fe - 1 JJ|A + J3i|. 

i=i 

When C = Ck-i is the collection of leave-one-out sets, Corollary H] resolves a conjecture stated 
in [8], namely if Bi = B\ + • • • + + Bi + \ + • • • + B^ for i = 1, . . . , k, 

k 

\A + D\ k < \D\Y[\A + B~\. 

i=i 

Clearly, various other choices of C yield other similar corollaries. We mention these only 
because they offer direct generalizations of Theorem 1.5 in Gyarmati, Matolcsi, and Ruzsa 
[8] and are independent of the results in Balister and Bollobas pp. 

Incidentally, Imre Ruzsa observed that sumset cardinality is not log submodular. Indeed, 
log submodular ity of sumset cardinality would imply that \kA\ is a log concave function of 
k, which is not the case. If \A\ = n and \2A\ = m, then |3^4| can be anywhere between cm 
and C min(m 3//2 , m 3 /n 2 ). 

3.5 Corollaries on non-Abelian sumsets 

One particular generalization that has been explored recently is that to non-Abelian groups. 
In particular, given X\, . . . ,Xk subsets of a non-Abelian group, can we find similar bounds 
on \Xi + • • • + Xk | as we did when the underlying group was Abelian? Unfortunately, the non- 
Abelian addition function is no longer partition-determined with respect to any collection of 
subsets; however, it is partition-determined with respect to some collections of subsets, and 
so with a little added work we can still use Lemma [3] to find bounds. To see that, in fact, the 
same bounds cannot hold, consider the following example. 

Example 3. Let G = {e, R, R 2 , F, RF, R 2 F} be the dihedral group on 6 elements, S = 
{e,F},T = {R}, and U = {e,F}. Then it is not the case that \S + T + U\ 2 < \S + T\\T + 

u\\s + u\. 

Proof. On one hand, we have that S + T = {R, FR}, S + U = {e, F}, and T + U = {R, RF}, 
and so \S + T\ \T + U\\S + U\ = 8. On the other hand, S + T + U = {R, FR, RF, R 2 } and so 
\S + T + U\ 2 = 16. □ 
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The underlying reason that non-Abelian groups cannot be bounded in such a way is that, 
in the example above, \S + U\ does not necessarily have any relation to \S + T + U\. So any 
bound will need to find some way to link the two. To do so, we will need to use stronger 
inequalities than the ones mentioned in the previous sections. We will derive them using a 
technique first introduced by Radhakrishnan [T7] in his simplified proof of Shearer's Lemma, 
and which has been used to find extended Shearer-type bounds (the most general of these 
appearing in [6l[T4]). However, the lemma below seems to be disjoint from results mentioned 
previously in the literature (and is a considerable strengthening of the similar Han inequality) . 
The general idea is that the entropy of a collection of random variables can be compared to 
the sum of the pairs of random variables conditioned on all of the random variables falling 
in between the pair. 

Lemma 5. Let Z = Z\, Z 2 , ■ ■ ■ , Z k be random variables, and define 

Z (i,j) = {Zt-i<t<j} 
for all 1 < i < j < k. Then, for k > 2, 

k k 

(k - 1)H(Z U Z 2 ,...,Z k )<J2J2 H(Z U Zj I Z {id) ) 

i=l j>i 

Proof. We will prove this by induction on k. The base case (when k = 2) is trivial, so assume 
the hypothesis to be true for k — 1 random variables and consider a collection of k random 
variables. The general idea will be to peel off all of the pairs that contain the random variable 
Z k and then appeal to the induction hypothesis for the other l ) pairs. We write H(Z) a 
total of k — 1 times, in different forms: 

H(Z)= H(Z 1 ,Z k \Z 2 ,...,Z k _ 1 ) + H(Z 2 ,...,Z k _ 1 ) 

H(Z)=H(Z 1 \Z 2 ,...,Z k _ 1 ,Z k ) +H(Z 2 ,Z k \Z 3 ,...,Z k _ 1 ) + H(Z 3 , . . . , Z k _ x ) 

H{Z) = H(Z\, Z 2 I Z 3 , . . . , Zfs-i, Z k ) + H(Z 3 , Z k | Z4, . . . , Z k -i) + HiZ^ . . . , Z k -\) 

H{Z) = H(Zi, . . . , Z k _ 3 I Z k _ 2 , Z k -i, Z k ) + H(Z k _ 2 , Z k \ Z k _i) + H(Z k _{) 

H(Z) = H(Z\, . . . , Z fc „ 3 , Z fe „2 I Zk-i, Z k ) + H(Z k _i, Zk) 

Note that the middle terms are all of the type H(Zi, Z k \ Zu k \) (in particular, H(Z k _\, Z k ) = 
H(Z k -i, Z k I Zr k _i^ k \) since Zi k _\^ k \ is empty). Furthermore, removing a random variable 
from the conditioning only decreases the entropy, so if we remove Z k from all of the leftmost 
terms, we get 

H(Z) < H(Z u Z k \Z (1)k) ) + H(Z 2 ,...,Z k _ 1 ) 

H(Z) < H(Zi I Z 2 , . . . , Z k _i) + H(Z 2 , Z k I Z(2 t k)) + H(Z 3 , . . . , Z k _i) 

H(Z) < H(Z 1 ,Z 2 \Z 3 ,...,Z k _ 1 ) + H(Z 3 ,Z k \Z {m ) + H (Z 4 , . . . , Z fc _0 



H(Z) < H(Zi, . . . , Zfc_ 3 j Z k _ 2 , Z k _i) + H(Z k _ 2 , Z k I Z(fc-2,fc)) + H(Z k _i) 
H{Z) < H(Zx, . . . , Z k - 3 , Z k - 2 I Zk-i) + H(Z k -i, Z k j Z^ k _i ^) 
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And now if we sum all of these inequalities, the entries in the leftmost column can be combined 
with the entries in the rightmost column that is one level higher to get 

fc-i 

{k-l)H{Z)<Y J H{Z u Z k | Z (i>k) ) + (k-2)H(Z 1 ,Z 2 ,...,Z k _ 1 ) 
i=i 

and the rest of the inequality follows by induction. □ 

Using Lemma [5j we can give a collection of inequalities for non-Abelian groups. 
Theorem 6. Let Xi,X 2 , ■ ■ ■ ,X k be subsets of a non-Abelian group, and define 

A(i,j) = m&x{\Xi + Xi+i H h Xj-i + Xj\ : Xi+i G X i+ i, . . . ,Xj-i G Aj_i} 

for all 1 <i < j < k. Then, for k > 2, 

\X 1 + X 2 + --- + X k \ k - X < J] A dJ) 

Proof. We define Z as before. By Lemma [5j we have that 

k k 

(k - 1)H(Z U Z 2 ,...,Z k )<J2Yl H(Z U Zj | Z {id) ) 

i=l j>i 

so it suffices to show that H(Zi,Zj \ -Z^j)) < log A(i,j). Note that in the Abelian case, we 
would have been pleased enough with H(Zi, Zj) but in the non-Abelian case, the sumset / 
that we used before is not (necessarily) partition-determined with respect to the partition 
{{i, j}, {i, j}}. In light of this, for each subset s C [k], we define the set function g as 

g s (xi, ...,x k ) = 



XliGs x i ^ s f° rms a consecutive interval in [k] 
(yii U2, ■ ■ ■ , Vk) where yi = Xi for i£s and yi = for i ^ s, otherwise 

It is easy to check that this g is partition-determined with respect to any partition. And 
while we have seemingly increased the sizes of a number of the sets that we wish to bound, 
the conditioning allows us to overcome this obstacle. 

H(Zi,Zj | = H(Z[ij]) - H(Z(ij)) = H(g[ij](Z)) - H(Z^) = H(g^^(Z) \ Z^) 

by Lemma [31 Furthermore, we have 

H(g [id] (Z) | = H (9[i,j](Z) | %j) = z (itj) )Pr{Z (Lj) = z {iJ) ) 

< max H(g [Lj] (Z) \ Z {i j) = z (iJ) ) 

< logmax{|Xj + x i+ i -\ h Xj-i + Xj \ : x i+1 G X i+1 , . . . ,Xj-\ G X,-i} 

= log A{i,j) 

since, under the assumption that Zuj\ = zu^, the range of gu^i is at most |Xj + z; L+ \ + • • • + 

Zj-!+Xj\. □ 
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Two interesting properties of our methods are revealed in Lemma [6l The first is that 
g does not have to (necessarily) be the obvious compound function — in fact, the normal 
sumset function is not partition-determined in the non-Abelian setting, and our choice of g 
was able to overcome this. The second is that the size of the sets gj only play a factor in the 
bound if s happens to be equal to some other t which is chosen in a different partition. Thus if 
we are careful, we can inflate some of the sets in order to make g partition-determined without 
changing the bound. The following corollary, which inspired Theorem (H was originally proved 
by Ruzsa [18]. 

Corollary 5. Let S, T, U be subsets of a non-Abelian group. Then 

\S + T + U\ 2 < max\S + T\\T + U\\S + t + U\. 
teT 

Curiously, the method seems to break down in other cases. In particular, it is unknown 
whether Theorem [6] remains true in the nonsymmetric case (using the same covering set 
of pairs, but having different weights a s ). In addition, different covering sets are also still 
unexplored. For example, the following problem posed by Ruzsa |18| remains open. 

Problem 1. Let S,T,U,V be subsets of a non-Abelian group. Is it true that 

\S + T + U + V\ 3 < max \S + T + U\\S + T + u + V\\S + t + U + V\ \T + U + V\l 

t.u 

Observe that the corresponding entropy inequality is not true; indeed, if one chooses 
Z 2 = Z 3 and Z\ = Z A = 0, then 

H(Z 2 ) = H(Z 1 ,Z 2 ,Z 3 ,Z i ) 

> I [H(Z 1 , Z 2 , Z 3 ) + H(Z 2 , Z 3 , Z A ) + H(Z U Z 3 , Z 4 \ Z 2 ) + H{Z U Z 2 , Z A \ Z 3 )] 

= \h(z 2 ). 

3.6 Corollaries on polynomial compound sets 

Although all of the examples and applications of partition-determined set functions thus 
far have been associated with sumsets, this does not need to be the case. Indeed, one 
can consider arbitrary "compound sets" obtained by plugging sets in as arguments of any 
function involving well-defined operations on the ambient space. In other words, for subsets 
X\, . . . , Xk of some ambient space X, we will always use the notation 

f(Xi, . . . ,X k ) = {/(zi, . .. ,Xk) ■ x\ € Xl, . .. ,x k e x k }. 

When the ambient space is a group, the only operation available is the sum, and all com- 
pound sets are sumsets. When the ambient space is a ring, one may consider compound sets 
built from polynomials. For particular ambient spaces, such as Euclidean space, the class of 
functions available is extremely broad and therefore so is the class of compound sets that can 
be considered. 

In this paper, we only illustrate the possible uses of our Theorem H] in the context of 
a ring. The result below works for possibly non-commutative, non-unital rings. Note that 
while one must take care to maintain the order of terms within any finite monomial over 
a non-commutative ring, one can still define polynomials (a sum of finite monomials) and 
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corresponding polynomial functions although they are no longer themselves commutative. 
For our purposes, monomials in 2 indeterminates x, y over a non-commutative ring could 
include, for instance, ax^cy^ex-^ g. We allow all such monomials with finitely many terms; all 
that matters is that when two such monomials appear with opposite signs in a polynomial, 
they cancel to the additive identity because of the commutativity of addition. 

Given sets Ai, . . . ,A^, and a function g, we will write g(A\, . . . ,Ak) to denote the set 
{g(a\, . . . ,a,k) '■ ^ € Ai}. While it is perhaps overly pedantic to draw specific attention to 
notation, it is nonetheless necessary here, due to the proliferation of similar notation in the 
additive combinatorics community (see |20j). In the usual notation for additive combinatorics, 
AB + BA is used to refer to {ab + b'a' : a, a' S A, b, b' € B}. However, when thinking of the 
compound set obtained by applying g{a, b) = ab+ba to sets A and B, we need to consider the 
set A ■ B © B ■ A = {ab + ba : a € A,b G B}. The symbols • and © are used to denote bound 
multiplication and addition operations, i.e., when they appear in an expression, repeated 
appearances of a set symbol in that expression mean that the same element of the set is 
substituted for each such appearance in computing the various instances of the expression. 
Our results could also be used to obtain results for the usual setting by using (for example) 
A ■ B © C ■ D where A, D (likewise B, C) are a posteriori taken to be the same set, but they 
will tend to be weaker than the bounds that exploit the algebra of the underlying ring. 

Theorem 7. Let R be a (possibly non- commutative and non-unital) ring. Suppose f : R m — > 
R can be extended to a function f on Q that is partition- determined with respect to C. For 
each i € [m], let gi E i?[xi, . . . ,x n ] be a polynomial in n indeterminates with coefficients in 
R, let gi : R n — > R be the corresponding polynomial function, and let g : R n — > R m be the 
function whose i-th component is gi. Let F : R n — > R be the polynomial function associated 
with the polynomial F £ R[x±, . . . ,x n ] obtained by reducing the expression 

f(yi, ■ ■ ■ Jm), with yi = 5 i (x 1 ,...,x n ) 

in the ^.-indeterminates, i.e., removing some pairs of monomials that are additive inverses of 
each other after substitution and expansion of terms. Then, for any collection X\, . . . ,X n of 
finite subsets of R, and for any fractional covering a with respect to the hypergraph C on [m], 

\F(X U . . . ,X n )\ < JJ 1/ o tt s o g(X u . . .,X n )\ a \ 
sec 

Proof. Observe that when y,, = t/j(xi, . . . ,x n ) are substituted in /(yi, . . . , y m ) and the re- 
sulting expression is expanded as a sum of monomials in the x-indeterminates, there is a 
polynomial C G i?[xi, . . . ,x n ] such that, before cancellation of any monomials, 

KYI, ■ ■ -Jm) = ^(Xl, . . . ,X n ) + C(xi, . . . ,X n ) - C(xi, . . . ,X n ), 

by the definition of F. Consequently, 

/(Yi, ...,Y m )= F(X U . . . ,X n ) © C(X 1 , ...,X n )Q C(X U . . .,X n ). 

Since the set C C is just the singleton {0} containing the additive identity (because these 
are bound operations), 

\F(X 1 ,...,X n )\ = \f(Y l ,...,Y m )\ 

<H\f(Y s )r 

sec 

= H\foiT s og(X 1 ,...,X n )\ a % 

sec 
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where we used Corollary [2] for the inequality. □ 

Example 4. Let A, B be subsets of a ring R. Then 

\A 2 © B 2 \ < \{A © B) 2 \ ■ \A ■ B © B ■ A\, 
where the squares are understood to be bound squares. 

Remark: When R is the ring of real numbers M, the inequality in Example H] implies that 
for any finite rectangular grid of points in the plane (corresponding to the Cartesian product 
A x B), the number of distinct circles centered at the origin passing through grid points is 
bounded by the product of the number of distinct lines of slope —1 passing through grid 
points and the number of distinct hyperbolae with the axes as their asymptotes that pass 
through the grid points. 

Proof. Let /(yi,y2) = y? - Y2- With yi = xi + X2 and y 2 = x x x 2 + x 2 xi, one finds 
,F(xi,X2) = (xi +X2) 2 — X1X2 — X2X1 = x 2 +x|. Since / is partition-determined with respect 
to {{1}, {2}} if we set /(yi) = y\ and /(y2) = y2> one can apply Theorem[7l □ 

A large class of further examples is provided by a general rule — whenever F can be 
factorized, one can use the product function for / (which is always partition-determined with 
respect to any C), and obtain bounds for the cardinality of the polynomial set in terms of 
the cardinalities of the "factor sets" . 

Corollary 6. Let R be a commutative ring. Suppose F € -ff[xi, . . . ,x n ] (written without any 
redundant monomials ) has a factorization of the form 

F(xi, . . . ,x n ) = _ [ g j (x 1 ,... ) x n ), 

je[m] 

where each gj is also a polynomial (typically not involving some of the x.-indeterminates) . 
Then for any collection X%, . . . , X n of finite subsets of R, and for any fractional covering a 
with respect to the hypergraph C on [m], 



\F(X u ...,X n )\ < J Jg j (X 1 ,...,X n 



sec 



Proof. Simply note that F(xi,...,x n ) = /(yi, . . . , y m ), with the correspondence yj = 
#j(xi, . . . ,x n ) and /(yi, . . . , y m ) = IljeM ^ ow / nas a trivial extension to Q, whose re- 
striction to Y s is given by f((yj ■ j € s)) = Y\j €s yj- An application of Theorem [7] completes 
the proof. □ 
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